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ABSTRACT : 

PROBLEM TO BE SOLVED: To pick up both a color image and a 
black/white image 

by the same imaging device and to pickup the black/white 
image at a high speed. 

SOLUTION: Color filters are arranged according to the RGB 
Bayer arrangement, 

and a spectral characteristics of the color filters is 
selected, so that 

outputs of color components R, G, B in 4 pixels in each color 
pixel group 6 in 

a color pixel matrix consisting of 2m-sets of pixels in the 
horizontal' 

direction and 2n-sets of pixels in the vertical direction are 
R:G:B=0 .299 : 0 . 587 : 0. 144 . A black/white image consisting of m 
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im^tl. *^*|6lt2mffl. Slt*[6lfc:2nffl(;0B« 

»6rtc04o«B*ti5ttSfe«^)-R. G. B<7)ffi* 
*i,R:G:B = 0. 299:0. 587:0. 144 

<04B*i&Jl©L/iS??^ai:'jm^f: LTaj^b-TS i t 

1 ox\ mm'f 1 0 tJtLTii^coKiftsij 

ffll^fT^ittiO. *5-B«?r#S^t*>-C^S. 
i/^. ;{?7-B«Sf6rtc04-:>coBS^Jlll[$-li-^ll!) 
Mfflli&tfdiktiO. SSacoaMB«&#S^fc*5 
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(G) . aH^fcWfe (B) . fl!50aM^tC*fe (R) 
iJ'X^mfiiL, 1i5IE±Tt*fcBI^&4aH«<0€^ 

±Tt*tl?S«-rS4aH««0rt. 2aBStJi^ 
(G) , aH«t»fe (B) , fl!!«OaH»(;i#fe (R) 

7-BS-7 h 'J ^ ;^.Ji*¥b mffl. fittb nffl<?)B^S^ 
fil;c . roiBSaSIfllffifc i 0 2 b B«<0«it S-JD 
nLXm^f-tiiU *Tmffl, attnffli<0B*ffi^2rig^ 
ffJ-r^fcJ-TTIgfc U^^t5:^fc-ri.ff^2t!B« 

54a B«<o«^?:jiiE LT . mmm^^^rm^tn-rz t 

fc&tl?i«-r54 aB«cO:frfe<i#Olfc*^WEL. I 

SE^aj-Ti ^lijigt: Lti^t ^#afc 

[00011 
[00021 

[«*<Og«l fi!*. * (R) . igb (G) . # (G) (7) 

(M) . H (Y) t7)fflfe5^;«j5-7-f;P5'^:frLTX?5 
-H«i&»«^51tffi«i^^fflv^TeMB«^IIJ:dfc 50 
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-r^Jl^. iiO)iX#3*T^;<f^-Bfii^«fi£-tl.#B« 

ay 7 b X rt: J: o T»S«fc:^So3^^te LT 
aUB^fc^^LxaJ^I LTV^it . 
[0 003imjf. R. G. B<rmm'^^j:i>iiy~ 

w&ii&^mmz^'th^. nTsc:fi^imm-t 

[ISci] 

Y=0. 299R+0. 587G + 0. 114B 
[00041 

ifimLfi::^y-mm^t>^Wmmz^-fhm^. ij 

ti^sfi. ^^')\iz-^mifhmiifh^>b'm 
ijy-mmi^hu^mz^m-thfz^xrm^ms. 

[0 00 51 3/i>fc. sataiiB 

[0 0061 ^:lX\ *fl«!B{±*^*»l.mS^?:I^L. 
;<r7-B»iJJ:tXeilBmi^}K*^H-<^Si«^^-Cli 
C b ifiX% . U*»t, ailH«<0ji«2:^3ffc1t 3 

mh^b-k^mb-^Th, 
[00071 

[aMa^j»*-^5^:J6«^SimiiOl6HHJi, ^ii^tt 
^mmmf^^^is^ V 'J ^X«fci!g$*T.fc1^c7)B 

4aB^£0rt. 2aBS{2tife(G) . aH«tWfe 
(B) , ffi<OaB^fc:*fe (R) co^^-^-f/l-rJ'^rlg 

mLxmm.fzfiy-m%-^v^)yxkm^\.. miB± 
T**fc:|?ffi^54 aB^<os^^iiiisrL-rii<J3i;^aj 

[ 0 0 0 8 1 m 1 mmx:\t. ±Tt*tci^-r5 4 a 

BS^liffaj:>jt-5J:o{cL-C»-^5<OT. |B|-cojj|M^ 
^^•C;<?^-B«Uiira«;^:»^)<oa®fi^co;^^f>r, 

\sm.^^<ni. o ^aiiBfiicofi^i&i«aMs»^±T 
[00091 %7.<7mmt. -e^t-fii^B^s^^fii 

i.vhy^'x«fc:ii;M$*ut1^oBS^*L. a^a 
^5^fcL/ifc#. ±Tte&fcl?l«-r*4aHac0rt. 2 
aBSt^fe (G) . aBSC^fffe ( B ) . ffljCOaB^ 
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t^fe (R) (D:^y-y ^JUiS^itmLXm^LfzAy 

[0010] m2ff)mTii. m i (^oMtomm^t 

[00 1 lllS3<0f|HBJi^ m2C0^iZii\^X. m, 

tz^*)mttt2bmmc^mm.Lxm;^aiL. * 
Tmffl, mm.nmff)mmm^^mi^ai-tz b ir^mb l 20 

[0012] m3cr>mmi. &mmmi:n?>m^iz. 
a ^-mm^^-fh^\iz)m tTs<t»*-m-rs 

Jti6. ^a«B«^#S i b f^X% h , 
[ooi3]m<ol6BH{i. W,3,(nmi\izii\^x. lolB 

T2mffl, mM.2vimfr>'^^im.'th^bts:<m7t-^ 

■t^-Yb^m^Lh^^bwm-h^b^^b-t 

[0 0 14] ^4<0^T«. flJO^i-S^Sfcli-o 30 

Jii^ ur ^;?^ai-r Yb\izmmx.h^b ifx% h <r> 
^hbbuz. m/mh^m^mii^x^ s . 

[0 0 15]^5O^J{i. »2iO|&Bg{ct5V^-C, aS: 
ejJ^t mi±T1£?^\iZ^^h4 aB*<0®?Sr 

Sit **T-& & i: t t>(c. m^9mms.iz3L'>xn&m 40 
looiei^emmi. mmm\izii\^x. mm 

i Oa^cofeiaSiv m-b Lfz%msD&^b 

0. aiiUfmbLtzb^. m±Ti^\izm&-thA 
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[0017] 

im\frmm<mm wm^mLLx^m^<rm 
mmaz-^^^xmrnth, mut. :^m^<r>-mmm 
\.zghhhWLimf<nm^^i^fmmx'hh. mm^ 
1 0J4. ^^-m i^-m) <n2mmiiivmmjij!^ 
m-}}^ ) 2 nm(nimL<rmn i mm^titzni y~m 
m'7V'}9xi:m^Lx\^h, ijy-mm^v'jyx 

R. G, B<0;>&7-H^*RGB'<.>f-V-E^J$il 
•CfeO. *¥*|Jdtinflit5j:i;iiit^r|plc7)nffl«0^<^ 
;<?7-B*fiP6tc:J:r>T<S«$iil., ^KTiRGB^^^ 

~m<nziinh 1 -^o;if7-Bmp 6J4. 2 X 2mm(r> 
A-:><mmit>hm^^ix. mui. iffi^ijtiiG. 

ltT25iJt:<4R. 2^imz\iB. 2ff25IJKJ4G«0# 

mmM^m:'fb Lx<^ztit^<mm i -eti-eii. 

R. G, B<fiii=7-mm<n\\-ftH}^bLXWi^L. Z.(n 

latigti. #B*i<o±n{c^R. G, ^<mkmk^^ 
<)v^im^ivx\^h, Lfzip-iX. mtii 
iitfimcommni. g (g) co;?«^^3iji$-ij-, g 
cofi-mM^^^L. ^m^•r?,zb^z^^. ^ 

[0018] 1 0 7-H«i^ti«-rsj© 

#SfiJritii£0B*it^3<xfe«lfJ4. Sttl^ 
Mm2iz^mLXiii:fj^ti. msmmj^2iziii:h^ti 

fzmi. #*^*iti]£OH« 1 izMm-r^mmmiz i g 

-fo. ir<5J*¥«j*lHl»3t:|5l»jLr!iSSI?*i, ?k¥lK 
MIHIS&3J4. 7k¥^rifilcoB«l tM^E-rsmi^S: 18^ 
oai:»j««iS4 m-LXtHijm^ 5 b LTfiiStfiA 
^mm 1 t;:^L:^S^^^TJ§# aj-T. iixC J: 0 , 

B, G, B. G. -^OBSfcJt^e-fS^jt. i5^«0g-C 

G, R, G, R, -(mfk^iznm-hnm. ^h\,zw) 

g-CB, G, B. G. ■••<OBSfcJt*5-r-&S?t**1^0M 

Lai:»]$fL. ft»g-cG, R. G. R, -(mmznm 
thvm\^-n^ixhb\^omim:i>'>x\^hti»>. 

m^^tihzbi,zt£t. 

[0019] ^<r>^ o^j:RGBK4^-mn\,Z-f 

I Q^fe^Ji. ^mmmznmhmmb . fen i . 

Qfc-C^Sit. RGB«fe^t<4, »:c7)^!«IM«2rl- 
[ia:21 

Y=0. 299R + 0. 587G + 0. 144B 
1=0. 596R-0. 274G-0. 322B 
Q=0. 211R-0. 522G + 0. 311B 
T-*S*^ feSII. Q\i^(>kz^<r)i:o\,z^m-hZ.b 
ifiXt. 
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1=0. 596 (R-G) +0. 322 (G-B) 
Q=0. 211 (R-G) -0. 311 (G-B) 
t^^<7)X\ RfcG. GtBtcrtmpmnT^tlli. 

HI, Qii^iz^ibihztt^T^h, z::x\ rg 

[ 0 0 2 0 ] mm^F 1 o*>\ ^m<7ym.Ti> 
s enams-sfii-rs^. 02 tc^-r i dtz.^^y 10 

«^ 1 o±Tm.^tL^ zcotm^tifz i-:>(r>m^tfim 

[002 1] ^t>iz. #;<r7-B«Sf6rti04O(^B# 
(C*tL. 1-9C0RC0B*: 2o<0GC0B*: 1-PCOBcO 
BS<0#fe)fi^<^ti}:^*«. -^-ix-ftlO. 29 9:0. 5 
87:0. 144i:^:5J:pt#R, G, BC0X^7-7 

-B*g6*WL!t«#ttY I Q^fei^cO»JSYfcffl 20 
SL. Ji^^ 1 0*»^>iOai^J«^5«, #;&5-B« 
SP6<7)BEafcfcJt5»e (Y) ^^^ft^'J-rSifctc^r 
0. mXnVhy^'X<7)J|l»BS8{i. SMBfll«0#B 
SSr^-r^tlc^rS (H3#Hg) . 

[0022] z<r)m^. mmmsc^^mii. mm 
[ 0 0 2 3 ] vi i mm^^ i o_ht fcttssmss 

«Sf6rt£7^1^i02O£0B* (GtBS>4V^JiRi: 

G) ^SiSKj*lHl»2±-ciinacL. ^wJnSct^Bfg? 30 
'i.fc:5:aj*Ji»4±-?W-r-5 J: 3 fc: L:^ t<7)T'& 

[0 0 24] •t<0m2»i, iiy-m$mefyffMim<0 

2rxmm:^^'9^mxwkti>mzm.L. z 
coimtmrni s i^izai:tjmm4±Tm-rt i o 

[0 0 2 5] ^<om3^i. ;<?7-B^6rtC04B*(0 
«25il<0St#qttSSm6iSlil»2<7);^fc#4B3l<7) 

^<^iz.mmiimm^2±-mimcommiism-t 40 

[0026] Z<^X o^rS®«^ 1 0±£0J|«[«. S«| 

s^i oizmhmmm(r>mmmti:itizX'o 

[0027] icOJ: ofc. 1 0±Xtii:f)m^5 

bLxtii:fj^ixhmx\ ^Ay-mmmepiff)4mm 

SrJifflLL. »SWcfflS-r-S^SSW=6:JlII[B«85:ltt 
mSii]m^5bLXtii^-thXolzLX\>-^t<^'C. ^fj 
^-B«af6rt«0R, G, B|&^^{Cit^?,SmS-?-<:0 
mshts:<X^,i(r>t.Wo\zUmm:^hZbff^X 50 
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[0028] ^:iJ, JiSLitSm^^ 1 Qt\<nijv-m 

Cii(cK^>-f. #*^-B^6rt£0fe«^R, G, B 
B*cOffia®a«ffST- J: V ^. 

[0 02 9] "ifz. im^ftmmfiQM. ccdh 

B^l ^X>f "5#BS1 rtfc^t:':: 

[0030] Wiz^ m 1 tcsrramsi^ 1 0 ^rau/^s 

«ilMt LT<7)S^;{^^7tCO(,>T04tJit^5^# 
HSLTittBB-ri.. 04 $l«^^10Srffli^-^:«^^;>& 

0J±. MS^^l lS:^LTA*J$ii/cS??*2 
8<7)fii$:m^fi-^tC^^-rS. i<^«t!^^l 1«. f^jl- 

[0031] CDS/AGCBISl 2«. ftfil^^^lO 

-p-Cy >f Xj£4)-$:iS«^S C D Sfffflfc^tJStJt i 
iSJiS^ffd AGCfPfflk^ifiLTA/D^JiSl 3{C 

[0 03 2] A/D^J^l 3{i, CDS/AGCHK 
1 2*»f>£0r^o^^ft^^ 1 Ob' 7 hOx^ V^fiM^ 
tl^LT . X -f i^':5'7l^^5!®a5 (DSP) 1 4 t'ttJ 
*-tS. ^i>. A/D^S13«, CDS/AGCE 
ffil 2*-^><^)r^o^^m^2r 1 0 b' y MjUiOx ^ i^'^J' 

[003 3] DSP14J±. A^J^iTJtlOt'yhcOT 

*»^>8b'«y Y\,z^\^tL^'{V9)Vf'-'9\,zn\.X'7V 
'J^'^. l&IWIiE^cOSPISrttL. 8b'./ hc7)»j^^ 
k 8 b'.y h<0fell«3)-*»A>^S 1 6 b' y h<7)T -< 

i^*^';Hl^J!yiffl<7)'7yf-.y7-LS i-cfcl.. iJt. D 
s P 1 4{i. mtm- 1 0<7)IB»ffl^'^ 5 

[00341 ffiffi/ff^ggj 1 5{i, mmnznthw^ 
flflcwtcfi. im.^-tAymi (dct) . a^oc 

■yT-rrJ-^^-CfeS. fflg/ffftSJl 5{i. y<>y 
7r^tU 1 6-^x-:J'BX'3a*. r-rJ'T^'-bXS: 
tfv\ DRAM-C»^$tlSA.y7ry*U 16t^tr 
S'J7l^>yi^A^t>ff 3, 

[003 5] Ay:7r^^'J 16J±. ffi^#^l 5 
t i-sTJBEiffi^&OTCT) 1 7l/-AiOBm7^-^'5:-^ 
W^h^^ U T-S) "5 . J:3*LAc J; 3 tCD R A M-CI®«$ 
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[0036] SRAM22«. EM/W^l Sti-o 
xmi&^hf<:mmT~:^izmx, JPECyr^ fit 

[00 3 7] 7^>yi^j«.^t'J2 6Ji. ^yifmtm 

mti>r^m&ji=tvx'S>i. 

[0038] i^gR-f y:?-:? i-X 2 7 Ji. ^n-V -f-iU 

[0039] T-< ^':5';l'Xy3-ri 7{±. t^v^';!' 
[0 04 0] ^^18«. LCDmX^^il. x-f 
[0041] XU- F5>f MiS2 4J±. m^T'i^SSiljt 

[0 04 2] LCD2 3«. 

[0043] cpu2Ui, i'tira-^'yt 
x-mj&^tifiiji . 
[0044] ^yy^moii. mmm^i o^ 

yf<)VXi:^m-h. 30 
[0045] gfi&*^10«. ±i*L3tDSP14*»^, 

(nmim^^^ ^yyj^)vx\izii-yxym^ixh. m^m 

^10<7)*^f|^fKjli<?5:rc«>c7)*¥I^AVl'XJi, DS 
P 1 4 *»^>^'^ 5 2 0 LTlS«Sifili«^ 

UT^BM^ixfcffi^KJ: ->Tgfii*i^ 1 0 ^mrt 

[0 04 6] ^i-c, Sf^a52 5<±, #acoai^t-K 

[0047] •t=5rt)*>, i£0a#aJ2 5£0«|^t- H^D 
«ix>f v^lZii-yXl^Ltziiy-m^ffyim^-Y 

CPU2m. DSP14fc;>^7-t-H*>m^:^ 
n^Clfc^rJgS^L. DSP14{±. #;!f7-BSSf6rt 
c04-ooBSSrffl3<^«#e3^Jffllfc«!-5T. 
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A/Dlg^SIl 3^:frLTA:ti$a^aJ:'Jti-^Sr;&5- 

[0048] t;ts CPU2 1{i. ;5r5-*-Ktc*tlS 

t-K*^$<TJtit^. cPU2ili. DSP 14*;: 
eil*-H*-'^$ilfcifcS:Jg^L. DSP14{i. 

y-mmme rt<o4o<oB«S:Jna$-y:5raffl^' 

A/D^^gSSilS^tfrLTA^bS^lfciliAfi^^e 
MB«ai:^tJtJE^I.m^3!!H^iirr. CPU2 

i«. eMt-KtJtiEL!t'e<ofl!!o#a5fc^«-s*g^ 
«ij»t>tTd. fit. ent-Hco:^. imm^Y(r)?^ 

^JliHIttltf i V^<0-C. D S P 1 4 COjIUiat^D S P 1 
[0049] ilJt. g|#liS25$r 

^LT;<f K fc ant- K t ^^wmmth i d 

t:LTV>S3&f. ::iLfcliRf>i'. CPU2 l*«HS^L^:v^ 
y-=^-Ylzmmx.hiioi,Z'thbX\.\ 

[ 0 0 5 0 ] ^fc, immazii o^tscofeiajK*^ 

iag^coMiE^??^ J:dt-tiU?J:v\ .roJl^. Ay- 
H^^tisftS . D s P 1 4 1 J: y~Wi.<r> 

[005 11 :izx\ asJi, ±^Lfzmri-iiy^y<n^ 
MSr^LTV^S. «i^;«r^7**|c3 1 Wi. a^t- 
Kfl]mX'f-/f-3 2. 3vyK^-f-l';l'3 3. LCD3 
4, ioirXH»-XX>f •yf-3 5 5r*LTV^S. gf^t 

H)-XX^ «y^3 5»i. 04{c:fcftSSf^SS2 50- 
ISTfeO. LCD34{i. 04fcfc(tSLCD2 3tffl 
S^S. Jil^t-K«SiX^ v^3 2li. 

H«.i[«LCD34rtfc^3tii.. av^Ky 
izm\^i^ix.hirA^)vx'h^, -e«os^*^iLCD 

34rt{c^;^*l.*. 
[0052] 

immss^^ mmmizwmLfziio^z. n^Krmm 
x\t. n-<nmmi-\,zi.'>xiiy-mm5i.x^^m 

xS)i>btuz. &mmmiim^i}'m.^tix\>^&f:: 
[0053] m2i)^t^m6^)^Tit. mi<7m 
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